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Abstract 

In this article we study a broad class of integer programming problems in variable dimension. 
We show that these so-termed n-fold integer programming problems are polynomial time solvable. 
Our proof involves two heavy ingredients discovered recently: the equivalence of linear optimization 
and so-called directed augmentation, and the stabilization of certain Graver bases. 

We discuss several applications of our algorithm to multiway transportation problems and to 
packing problems. One important consequence of our results is a polynomial time algorithm for 
the d-dimensional integer transportation problem for long multiway tables. Another interesting 
application is a new algorithm for the classical cutting stock problem. 



1 Introduction 

The integer programming problem is the following discrete optimization problem, where N denotes the 
set of nonnegative integers, A is an integer matrix and b, c are integer vectors of suitable dimensions: 

min{cx : Ax = b, x £ N 9 }. 

It is well known to be generally NP-hard but polynomial time solvable in fixed dimension q, see |2U| . 

In this article, motivated by applications to high-dimensional transportation problems and con- 
tingency tables and by the recently discovered striking universality theorem for rational polytopes (Hj 
(see Section |2J), we study the following class of integer programming problems in variable dimension. 
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The n-fold integer programming problem. Fix a p x q integer matrix A. Given positive integer n 
and integer vectors b = (b°, b 1 ,. . . , b n ) and c = (c 1 , . . . , c n ), where b° G Z 9 , and 6 fc G Z p and c fc G N 9 for 
k = 1, . . . , n, find a nonnegative integer vector a; = (x 1 , . . . , x n ), where x k G N 9 for A; = 1, . . . , n, which 
minimizes cx = Y^k=i c^ 2 ^ subject to the equations X^fc=i ^ = ^° ano - = ^ f° r ^ = 1> • • • > n - 

The term "n-fold integer programming" refers to the problem being almost separable into n similar 



programs min{c fc x : Ax k = b k , x k G N 9 } in fixed dimension; however, the constraint ^ 



k=i ■ 
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binds these programs together, and the result is an integer program in large variable dimension nq. 
Let the n-fold matrix of A be the following (q + np) x nq matrix, with I q the q x q identity matrix: 
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Then the n-fold integer programming problem can be conveniently written in matrix form as 

min{cx : A^x = b, x G N nq } . 



In this article we establish the following theorem. Naturally, the input size is n plus the bit size of 
the integer objective vector c G 1i nq and the integer right-hand side vector b G Z 9+rap . 

Theorem 1.1 Fix any integer matrix A. Then there is a polynomial time algorithm that, given any 
n and any integer vectors b and c, solves the corresponding n-fold integer programming problem. 



The proof of this theorem involves two heavy ingredients. First, it makes use of the equivalence of the 
linear optimization problem and the directed augmentation problem, recently introduced and studied 
in [2^. Second, it uses recent results of [THj and ^|[ on the stabilization of certain Graver bases. 

One important consequence of Theorem 11.11 is a polynomial time algorithm for the 3- way trans- 
portation problem for long tables, settling its computational complexity; see Section |2] for details. 

Corollary 12.21 Fix any r, s. Then there is a polynomial time algorithm that, given I, integer objective 
vector c, and integer line-sums (uij), (vi ;k ) and (wj jk ), solves the integer transportation problem 

min{ cx : i£f xsx ', x iij)k = w j>k , x it j )k = v i;k , Xij tk = u itj } . 

i j k 
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The n-fold integer programming problem and theorem can be generalized as follows. 

Generalized n-fold integer programming. Fix integer matrices A, B of sizes r x q and s x q, 
respectively. Given positive integer n and integer vectors b = (6°, b , . . . , b n ) and c = (c , . . . , c n ), with 
6° € Z s , and b k G 27 and c k G N 9 for A; = 1, . . . , n, find x = (x 1 , . . . , x n ) with x k G N 9 for A; = 1, . . . , n, 
which minimizes cx = X^fc=i c fc x fc subject to Ylk=i Bx k = ^° an d Ax k = b k for k = 1, . . . , n. 

We have the following more general result, from which Theorem 1 1.1 1 is deduced in the case B = I q . 



Theorem 1.2 Fix any pair of integer matrices A,B of compatible sizes. Then there is a polynomial 
time algorithm that solves the generalized n-fold integer programming problem on any input n, b, c. 

The article is organized as follows. In Section |2] we discuss applications of Theorem ll.ll to multiway 
transportation problems and to some packing problems, as follows. In l2.1l we obtain the aforementioned 
Corollary 12 . 21 which provides a polynomial time solution to 3- way integer transportation problems for 
long tables, contrasting the recent universality theorem of 6 for slim tables. We also extend this 
result to (f-way transportation problems for long tables of any dimension fCorollarv 12.41) . In 12.21 we 
describe applications to a certain shipment problem (Corollary I2.5|) and to the classical cutting stock 
problem (Corollary 12. 6|) . In Sections 3 - 4 we develop the necessary ingredients for our n-fold integer 
programming algorithm, as follows. In Section 3 we discuss Graver bases and augmentation. We show 
(Lemma I3.2|) that the Graver basis allows to solve the directed augmentation problem introduced 
recently in j^J, and, combining this with the results of |2J, show that any feasible solution to an 
integer program can be augmented to an optimal one in polynomial time provided the Graver basis is 
part of the input (Theorem 13. 3|) . In section 4 we discuss the stabilization of Graver bases discovered 
recently in |131 I19j . and use it to show that Graver bases of n-fold matrices can be computed in 
polynomial time (Theorem 14. 2|) . Finally, in Section 5, we combine all the ingredients from Sections 3 
and 4, and prove our main result Theorem 11.21 and its specialization Theorem ll.il 

2 Applications 

2.1 High dimensional transportation problems 

A d-way transportation polytope is the set of all mi x • • • x nonnegative arrays x = (xi lr .. ) i d ) such 
that the sums of the entries over some of their lower dimensional subarrays (margins) are specified. 
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For simplicity of exposition, we shall concentrate here only on d-way line-sum polytopes, of the form 
x fc M + : / j x h,—,id ~ u i2,—,id ' / j Xi i,—,id ~~ Ui i,i3,—,U ) / , 3 



*2 id 



Transportation polytopes and their integer points (called contingency tables by statisticians), have 
been studied and used extensively in the operations research literature and in the context of secure 
statistical data disclosure by public agencies such as the census bureau and the national center for 
health statistics. In the operations research literature, one is typically interested in the integer and 
linear transportation problems, which are the integer and linear programming problems over the trans- 
portation polytope, see e.g. (21 El El El HH H3] and references therein. In the statistics community, 
one is often interested in the values an entry can attain in all tables with fixed margins, related to the 
security of the entry under margin disclosure, and in the construction of a Markov basis allowing a 
random walk on the set of tables with fixed margins, see e.g. ^ |IJ 03 E] an d references therein. 

It is well known that the system defining a 2-way transportation polytope is totally unimodular. 
This implies that all the above problems are easy in this case. However, already 3-way transportation 
problems are much harder. Consider the problem of deciding if a given 3-way line-sum polytope of 
r x s x I arrays (with r rows, s columns and I layers) contains an integer point: the computational 
complexity of this problem provides useful indication about the difficulty of the problems mentioned 
above. If r, s, I are all fixed, then the problem is solvable in polynomial time by integer programming 
in fixed dimension rsl. On the other hand, if r, s, I are all variable part of the input, then the problem 
is NP-complete [Tl|- The in-between cases are much more delicate. The case of two parameters r,s 
variable and one parameter I fixed was recently resolved in [5], where it was shown to be NP-complete, 
strengthening [Tl]. Moreover, very recently, in jH], the following striking universality result was shown. 



Proposition 2.1 Any rational polytope P = {y € : Ay = b} is polynomial time representable as 
a 3-way line-sum transportation polytope of size rxsx3 for some (polynomially bounded) r and s, 

i j k 

Here representable means that there is a coordinate-erasing projection from K rxsx3 onto R n providing 
a bijection between T and P and between the sets of integer points TflZ rxsx3 and PnZ". Thus, any 
rational polytope is an r x s x 3 line-sum polytope, and any integer (respectively, linear) programming 
problem is equivalent to an integer (respectively, linear) r x s x 3 line-sum transportation problem. 
This result led to the solution of several open problems from [^U an d |23j and had several implications 
on the complexity of Markov bases and the entry security problem, see [H] and (7] for more details. 



4 



However, the last case, of two parameters r, s fixed and one parameter I variable, has remained 
open and intriguing. Here, as a consequence of Theorem ll.il we are able to resolve this problem and 
show that both the decision and optimization problems are polynomial time solvable. 



Corollary 2.2 Fix any r,s. Then there is a polynomial time algorithm that, given I, integer objective 
vector c, and integer line-sums (uij), (vi tk ) and (vjj jk ), solves the integer transportation problem 

min{cx : x G N rxsx ' , ^ x iJik = w jik , ^ x iijjk = v i)k , ^ Xi,j,k = u i,j } ■ 

i j k 

Proof. We formulate the 3-way integer transportation problem as an n-fold integer program with 
n := I, p := r + s, and q := r ■ s. Reindex the variables that the variables vector 

is x = (x 1 , . . . ,x n ) with x k = {x k •) G N rxs a 2-way r x s table - the kth. layer of the 3-way table x. 
Similarly write c = (c 1 , . . . , c n ) with c k G Z rxs for the objective vector. Next, put b := (b°, b 1 , . . . , b n ), 
with b° G N rs defined by b° := (u id ), and b k G N r+S defined by b k := {(v itk ), (w jjk )) for k = 1, . . . , n. 
Finally, let A be the pxq = (r+s) xr-s matrix of equations for the usual 2-way transportation polytope, 
forcing row-sums and column-sums on each of the r x s layers x k by Ax k = b k , k = 1, . . . , n. Then 
the equations Ax k = b k force the line-sums v^ k and wj, k , and the additional n-fold integer program 
binding constraint Y^! k =x x = ^° f° rces t ne "long" line-sums Uij. This completes the encoding. Since 
r, s are fixed, so are p, q, and A, and therefore, the corollary follows from Theorem ll.il □ 



Example 2.3 Consider the case r = s = 3 (the smallest where the problem is genuinely 3-dimensional) . 
Then p = 6, q = 9, and writing x k = (xfi, x\ 2 , x k 3 , x k 1: x\ 2 i x \$-> x 3,i) x \%i x 3,3)> the matrix A which 
defines the n-fold program providing the formulation of the 3x3x1 transportation problem is 

(l 1 
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Already for this case, of 3 x 3 x I tables, the only polynomial time algorithm for the corresponding 
line-sum integer transportation problem we are aware of is the one guaranteed by Corollarv l2.2l ab ove . 



Corollary 12.21 extends to transportation problems of any dimension d, for long tables, namely, of 
size mi x • • • x to^-i x /, where mi, . . . , m^_i are fixed and only the length / is variable, as follows. 
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Corollary 2.4 Fix d,mi, . . . ,md-i- Then there is a polynomial time algorithm that, given I, integer 
objective c, and line-sums (iij 2 . » d ), • • • , (ui 1 ,...,i d ^ 1 ), solves the long multiway transportation problem 

minjcx : xEN 1 d 1 : ^ ^ x ii,—>id = u i2,—,idi •••> ^^ x h,—,id = ^lv.'d-i }• 

Proof. The long multiway transportation problem can be encoded as an n-fold integer program with 
n := I, p := Yli=i m ii an d Q '■= Tlti m «> by reindexing the variables as i := x^...^, letting 
A be the matrix of equations of line-sums of (d — l)-way transportation polytope of m\ x • • • x m^-i 
arrays, and proceeding in direct analogy to the proof of Corollary 12.21 The details are omitted. □ 

2.2 Some packing problems 

Minimum cost shipment 

The minimum cost shipment problem concerns the shipment of a large stock of items of several types, 
using various vessels, with minimum possible cost. More precisely, the data is as follows. There are t 
types of items. The weight of each item of type j is Wj and there are rij items of type j to be shipped. 
There are v available vessels, where vessel k has maximum weight capacity u/.. The cost of shipping 
one item of type j on vessel k is Pj,k- We now formulate this as an n-fold integer programming problem. 
We set n := v, p := 1, q := t+ 1. The defining matrix is the row vector A = (Aj) := (wi,W2, • • • , Wt, 1). 
The variables vector is x = (x 1 , . . . , x n ) with x k = (x\, . . . , x^, x^), where Xj represents the number of 
items of type j to be shipped on vessel k for j = 1, . . . , i, and x k q is an extra slack variable representing 
the unused weight capacity in vessel k. The cost vector is c = (c 1 , . . . , c n ) with c k = (c k , . . . , c k , c k ), 
where c k := pj^ for j = and c k := 0. Finally, the demand vector is b = (b°, b 1 , . . . , b n ) 

with b k := Ufc for k = 1, . . . , n, and b° := (m, . . . ,nt, Sfc=i u k — Sj=i n j w j)- Then the resulting n-fold 
integer programming problem, minjcx : A^x = b, x E N™ 9 }, can be written in scalar form as follows: 

q n t v 

min J2J2 C J X J = 

j=l k=l j=l k=l 

n 

s.t. ^ X k = b°j = nj , j = l,...,t 

fc=l 

n v t 

x \ = b °g = Yl Uk ~ Yl n i w i 

k=l k=l j=l 

q t 

Y. Aj x k = Y2 w j x j + x \ = b k = u k , k = 1,... ,n 

3=1 3=1 

x k eN, j = l,...,q, k = l,...,n. 
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Assume that the number t of types is fixed, but the numbers rij of items of each type may be very 
large: this is a reasonable assumption in applications (for instance, several types of automobiles to be 
shipped overseas, or several types of appliances to be shipped on ground). Then we obtain the following 
striking corollary of Theorem 11.11 showing that the problem is polynomial time solvable, where the 
input size is v plus the bit size of the integer numbers rijjUfcPj^ constituting the data. Note that this 
result is much stronger than the standard results on the pseudo-polynomial time solvability of this 
kind of packing and knapsack-type problems using dynamic programming: our algorithm can handle 
very large rij and Uk, possibly exponential in the dimensional parameter v. 

Corollary 2.5 For any fixed number t of types and type weights Wj, the minimum cost shipment 
problem is solvable in time which is polynomial in the number v of vessels and in the bit size of the 
integer numbers rij of items of each type to be shipped, vessel capacities Uk, and shipment costs Pj t k- 

The cutting stock problem 

This is a classical manufacturing problem, where the usual setup is as follows: a manufacturer supplies 
rolls of material (such as scotch-tape or band-aid) in one of t different widths w\, . . . ,wt- The rolls are 
all cut out from standard rolls of common large width u, coming out of the production line. Given 
orders by customers for rij rolls of width Wj, the problem facing the manufacturer is to meet the 
orders using the smallest possible number of standard rolls. This is almost a direct special case of 
the minimum cost shipment problem discussed above, with sufficiently many identical vessels, say 
v := X^'=i \ n jl l u / w j\~\i °f capacity Uk ■= u each, playing the role of the standard rolls, and with cost 
Pj^k '■= Wj for each roll of width Wj regardless of the standard roll from which it is being cut out. The 
only correction needed is that each slack variable x q = measuring the unused width of the kth. 

standard roll, has cost of one unit instead of zero, so that the total cost becomes the number of standard 
rolls used. Thus the formulation as an n-fold program is with n := Ylj=i \ n jl L^/^jJl > P := 1; Q := t+1, 
A := (w\,W2, ■ ■ ■ ,wt, 1), variables Xj representing the number of rolls of width Wj cut out of the kth 
roll for j = 1, . . . , t and x q representing the unused width of the kth. standard roll, costs Cj := Wj for 
j = 1, . . . , t and Cg := 1, and demands b k := u for k = 1, . . . , n and b° := (n\, . . . ,n t ,nu — Yfj=i n j w j)- 

Again, quite surprisingly, we get the following useful corollary regarding this classical problem. 

Corollary 2.6 For any fixed t and widths wi, . . . ,wt, the cutting stock problem is solvable in time 
polynomial in X^j=i \ n jl L^/^jJl an d ^ n ^ e bit size of the numbers rij of orders and raw roll width u. 

One common approach to the cutting stock problem makes use of so-called cutting patterns, which 
are feasible solutions of the knapsack problem {y € N* : Y2j=i w jVj — u }- This is useful when the 
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width u of the standard rolls is of the same order of magnitude as the demand widths Wj. However, 
when u is much larger than the Wj, the number of cutting patterns becomes prohibitively large to 
handle. But then the values [u/wj\ are large and hence n := Y2j=i \ n j /Y u / w jW ls small, in which case 
the result of Corollary 12.61 using n-fold integer programming becomes particularly appealing. 

3 Graver bases and directed augmentation 

Consider the following family IP^ of integer programs in standard form, with arbitrary demand vector 
b G Z m and arbitrary objective vector c G Z n , sharing the same constraint matrix A G ^ mxn , 

IP aQ>,c) : min{cx : Ax = b, x G N™}. 

A universal test set for the family IP a is a finite subset G of the lattice C{A) := {x G Z n : Ax = 0} 
of dependencies on A such that whenever x is feasible but not optimal for IP^ft, c) (where b := Ax), 
there is an improving direction g G G, namely such that x — g is feasible and better, that is, x — g G N n 
and eg > 0. Thus, a universal test set enables the solution of the following augmentation problem. 

Augmentation problem. Given A G Z mxn , x G N n and c G Z n , either find an improving direction 
j G Z n , namely one with x — g G {y G N n : Ay = Ax} and eg > 0, or assert that no such g exists. 

An augmentation oracle for a matrix A is one that solves the augmentation problem, that is, when 
queried on x G N n and c G Z n , it either returns an improving direction g or asserts that none exists. 
Clearly, an explicit universal test set G for A enables the efficient realization of an augmentation 
oracle for A by simply searching for an improving direction g G G. An oracle solving the augmentation 
problem, and in particular, an explicit universal test set G, enable the following simple iterative 
procedure that, for any program IP A_(b,c) in IP a with bounded objective function, converts any 
feasible x to an optimal one: "while there exists an improving direction g set x := x — g and repeat". 

In 1975, Graver [S] constructed, for every integer matrix A, a canonical universal test set. The 
Graver basis Q{A) of A can be defined as follows. First, we need to extend the partial ordering < from 
N n to Z n . For u,v G Z n we say that u is conformal to v, denoted u C v, if \ui\ < \vi\ and U{Vi > for 
i = 1, . . . , n, that is, u and v lie in the same orthant of W 1 and each component of u is bounded by the 
corresponding component of v in absolute value. With this, Q(A) consists precisely of all C-minimal 
vectors in C{A) \ {0}. For a more detailed introduction of Graver bases we refer to |1U| . The currently 
fastest algorithm to compute Graver bases, based on a completion procedure and a project- and- lift 
approach, is described in and implemented in the software package 4ti2 |12j . 

The Graver basis, being a universal test set, provides an augmentation oracle and hence enables 
to convert any feasible solution to an optimal one for any IP a (b, c) by the iterative augmentation 
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procedure above. But this in itself is not enough to guarantee an efficient (polynomial time) solution: 
a major remaining question is how many augmentation steps are needed to reach an optimal solution. 

Recently, in a directed version of the augmentation problem was introduced; quite remarkably, 
it was shown that the number of directed augmentation steps needed to reach optimality is polynomial. 
We discuss this next. First, we define the directed augmentation problem. 

Directed augmentation problem. Given A G Z mxn , x G N™ and c',c" G I n , either find g = 
g + — g~ G Z n satisfying x — g G {y G N™ : Ay = Ax} and c'g + — c" g~ > 0, or assert that none exists. 

Here and throughout, g + ,g~ G N™ denote the positive and negative parts of g G Z n , defined by 
gf := max{<7j,0} and g~ := — min{gj,0} for i = 1, . . . ,n. Thus, the directed augmentation problem 
involves two objective function vectors: d controls the cost of the positive part of g and c" controls the 
cost of the negative part of g. The usual augmentation problem occurs as the special case d = c" = c. 
A directed augmentation oracle for A is one that solves the directed augmentation problem, i.e. when 
queried on x G N n , c',c" G Z n , it either returns an improving direction g or asserts that none exists. 

In it was assumed that the input includes an upper bound vector u G N n on the variables, so 
that the actual feasible set is {y G N™ : Ay = Ax, y < u}. Under this assumption, the feasible region 
is always bounded and there is always an optimal solution. Further, the complexity estimates in 
depended on the bit size of u and b := Ax. However, this is not really needed. Consider the integer 
program IPyi(6, c) : minjcy : Ay = b, y G N"} with b = Ax. Its objective function is bounded (and 
hence there is an optimal solution) if and only if it is bounded for the corresponding LP-relaxation 
min{cy : Ay = b, y G WL}, which can be checked in polynomial time by linear programming. 
Furthermore, whenever IP^fr, c) has an optimal solution, it has one of bit size polynomially bounded 
in the size of A and b = Ax; this basically follows from Cramer's rule, see e.g. |2U1 Section 17.1]. 
Therefore, it is possible to compute an upper bound u in terms of A and x only, and plug it into the 
analysis of |2J; for instance, '■= m\ n{n + l)(max |xj|)(max |Ajj|) m for k = 1, . . . ,n will do. 

With this, the results of imply the following. 

Proposition 3.1 There is a polynomial oracle time algorithm that, given A G Z mxn , x G N n ; c G 7L n , 
solves the integer program IPA(b,c) with b := Ax by querying a directed augmentation oracle for A. 

Here, as usual, solving the (feasible) integer program means that the algorithm either returns an 
optimal solution or asserts that the objective function is unbounded; and polynomial oracle time 
means that the number of arithmetic operations, the number of calls to the oracle, and the size of the 
numbers occurring throughout the algorithm are polynomially bounded in the size of the input A, x, c. 

It is not hard to see that if the matrix A is totally unimodular, in particular the incidence matrix of 
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a directed graph, then a directed augmentation oracle for A can be realized using linear programming. 
However, in general it is not clear which matrices A admit efficient directed augmentation. 

As explained above, the Graver basis of a matrix A yields an augmentation oracle for A. We now 
show that, moreover, it enables the realization of a directed augmentation oracle for A as well. 

Lemma 3.2 Let Q(A) be the Graver basis of A £ % mxn . p or an y x G N n and d,d' £ 7L n , there is a 
g £ Z n with x — g £ {y £ N ra : Ay = Ax} and c'g + — c"g~ > if and only if there is such g £ G(A). 

Proof. Suppose g is an improving direction. Then g E £{A) \ {0} and hence can be written as a 
conformal sum of (not necessarily distinct) elements of the Graver basis of A, that is, g = Q % with 
g l C g and g l E Q{A) for all i. To see this, recall that Q{A) is the set of C-minimal elements in 
C(A) \ {0} and note that C is a well-ordering; if g E G(A), we are done; otherwise there is an h E Q{A) 
with h C <? in which case, by induction on C, there is a conformal sum g—h = ^ g % giving g = g % ■ 

Now, g % C g is equivalent to < (? + and (g l )~ < y - , so the conformal sum g = ^2g l gives 

corresponding sums of the positive and negative parts g + = ^2(g l ) + and g~ = ^2(g l )~ ■ Consequently, 

< c'g+-c"g- = </XV) + -^XV)- = £(cV) + -cV)-), 

which implies that there is some g l in this sum with c'(g l ) + — c"(g l )~ > 0. Now, g l E Q{A) C £(j4) so 
A^f* = and hence A{x — g % ) = Ax. Finally we show that x — g % > 0: if g % - < then Xj — g % - > xj > 0; 
and if g'j > then g l C ^ implies < 5^ and thus Xj — g l j > Xj — gj > 0, the last inequality holding 
because g is an improving direction. So g % £ Q{A) is an improving direction in the Graver basis. □ 

As an immediate corollary of Proposition 13.11 and Lemma 13.21 we get the following statement. 

Theorem 3.3 There is a polynomial time algorithm that, given any matrix A £ 2 mxn along with its 
Graver basis G(A), and vectors x £ N n and c £ TU 1 , solves the integer program IPj^(b, c) with b := Ax. 

While Theorem 13.31 holds for any matrix, its complexity bound depends on the size of the Graver 
basis which is part of the input. Typically, the Graver basis is very large and its cardinality may be 
exponential in n. However, in the next section we show that for a broad and useful class of matrices, 
we can tame the behavior of the Graver basis, leading to an efficient algorithm in terms of A, x, c only. 
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4 Graver bases of n-fold matrices 



Fix any pair of integer matrices A and B with the same number of columns, of dimensions r x q and 
s x q, respectively. The n-fold matrix of the ordered pair A, B is the following (s + nr) x nq matrix, 



[A,B}W 



(l n ® £) © {I n <g> A) 



(b 
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B ■ 


• b\ 


A 
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■ 
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• 



y o o o ■•• a J 

With this, the generalized n-fold integer programming problem can be conveniently written as 

min{cx: [A, B] {n) x = b, x G N nq } . 

The n-fold of a single matrix A, defined in the introduction, is the special case A^ = [A,I q ]^ with 
B = I q the q x q identity, giving the regular (non-generalized) n-fold integer programming problem. 

We now discuss a recent result of |19| and its extension in ^3] on the stabilization of Graver bases 
of n-fold matrices. Consider vectors x = (x l , . . . , x n ) with x k G N 9 for k = 1, . . . , n. The type of x is 
the number \{k : x k ^ 0}| of nonzero components x k € N 9 of x. The following result of ^3] on the 
stabilization of Graver bases of [A, B]^ extends the earlier result for B = I q from |19j . 

Proposition 4.1 For every pair of integer matrices A G 27 x 9 and B G Z sxq , there exists a constant 
g(A, B) such that for all n, the Graver basis of [A, B]^ consists of vectors of type at most g(A, B). 

The smallest constant g(A, B) possible in the proposition is called the Graver complexity of A, B. 
Using Proposition 14.11 we now show that g{[A,B}^) can be computed in polynomial time. 



Theorem 4.2 Fix any pair of integer matrices A G Z TXq and B G 7* sxq . Then there is a polynomial 
time algorithm that, given n, computes the Graver basis G([A, B]^) of the n-fold matrix [A, B]( n > . In 
particular, the cardinality and the bit size of Q([A, B]^) are bounded by a polynomial function of n. 



Proof. Let g := g(A,B) be the Graver complexity of A, B and consider any n > g. We show that the 
Graver basis of [A, B]^ is the union of (™) suitably embedded copies of the Graver basis of [A, B]^ 9 \ 
Consider any g indices 1 < k\ < • • • < k g < n and define a map (f>ki,...,k from N 9<? to ~N nq by sending 
x = (z 1 , . . . ,x g ) to y = (y 1 , . . . ,y n ) defined by y kt := x l for t = 1, ... ,g, and y k := for all other k. 
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We claim that the Graver basis of [A, B]^ is the union of the images of the Graver basis of [A, B]^ 
under the (™) maps <f)k lt ...,k g for all 1 < fci < ■ ■ • < fc 9 < n, that is, 

g([A,B]V>) = |J kl ,..., kg (g([A,B}^)) . (i) 

l<hi<— <h g <n 

To see this, recall first that, by definition, the Graver basis of a matrix M is the set of all C-minimal 
nonzero dependencies on M (where a dependency on M is a vector x satisfying Mx = 0). Thus, 
if x = (x 1 ,...,^ 9 ) € Q{[A,B]te)) then x is a C-minimal nonzero dependency on [A, By 9 \ implying 
that 0A; 1 ,... J fc g (aj) is a C-minimal nonzero dependency on [A, B]W and hence (f>k u ...,k g ( x ) G 5]^)- 
This establishes that the right-hand side of (1) is contained in the left-hand side. Conversely, consider 
any y € Q([A, B]^). Then, by Proposition 14.11 the type of y is at most g, so there are indices 
1 < k\ < ■ ■ ■ < kg < n such that all nonzero components of y are among those of the reduced vector 
x := (y kl , . . . , y kg ), and therefore y = 4>ki,...,k g { x )- Now, y £ £/(p4, By n ') implies that y is a C-minimal 
nonzero dependency on L4, i?]( n ), and therefore x is a C-minimal nonzero dependency on [A, By- 9 ' and 
hence x E £7 ([-A, -B]^), showing that y € 0fc 1( ...,fc 9 (£?([AL, B]^)). This establishes that the left-hand side 
of (1) is contained in the right-hand side. Thus, the Graver basis of [A, B]^ is indeed given by (1). 

Since A, B are fixed and hence g = g(A,B) is constant, the g-fold matrix [A, By 9 ' is also fixed 
and so the cardinality and bit size of its Graver basis <7([A, By- 9 ') are constant as well. It follows from 
(1) that \G([A,B]^)\ < Q)\g([A,B]<*))\ = 0(n 9 ). Further, each element of g([A,B} ( ^) is an nq- 
dimensional vector (j>ki,...,k g { x ) obtained from some x € g([A, B]^) (of constant bit size) by appending 
zero components, and therefore is of linear bit size 0(n), showing that the bit size of the entire Graver 
basis g([A,B}^) is 0(n 9+1 ). Finally, it is clear that the Q = 0(n 9 ) images </> kl ,...,k g (G([A, B}^)) 
and their union g([A, B]^) can be computed in time polynomial in n, completing the proof. □ 



Example 4.3 Consider the matrices A = [1 1] and B = l<i- The Graver complexity of the pair A,B 
is g(A, B) = 2. The 2-fold matrix and its Graver basis, consisting of two antipodal vectors only, are 



[A, B}^ = A® 



( 1 1 \ 
10 1 
110 
11 



g([A,B] 



(2b 



1 -1 



•1 1 



By Theorem 14.21 the Graver basis of the 4- fold matrix [A, B]^ = A^ can be computed by taking 
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the union of the images of the 6 = ( 2 ) maps ^>/ Cl 



k 2 



J2-2 



N for 1 < k\ < &>2 < 4, and we obtain 



[A,B] 



(4) 
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5 The polynomial time algorithm for n-fold integer programming 

We now provide the polynomial time algorithm for the generalized n-fold integer programming problem 

min{ca;: [A, B] {n) x = b, x E N nq } . (2) 

First, combining the results of the previous two sections, we get a polynomial time procedure for 
converting any feasible solution to an optimal one. We record this result in the following lemma. 



Lemma 5.1 Fix any pair of integer matrices A E W xq and B E 7, sxq . Then there is a polynomial time 
algorithm that, given n, objective vector c E N nq , and nonnegative integer vector x E N™ 9 , solves the 
generalized n-fold integer programming problem in which x is feasible, i.e. the one with b := [A, B]( n 'x. 

Proof. First, apply the polynomial time algorithm underlying Theorem 14.21 on input n and compute 
the Graver basis £7 ([-A, B]^) of the n-fold matrix [A, B]( n \ Then apply the polynomial time algorithm 
underlying Theorem 13.31 on input [A, B]( n \ Q([A, B)^), c and x, solving the integer program (2). □ 

We now show that, moreover, given any b, we can efficiently find an initial feasible solution to (2). 

Lemma 5.2 Fix any pair of integer matrices A E 27 x 9 and B E Z sx<? . Then there is a polynomial 
time algorithm that, given n and demand vector b E N s+nr , either finds a feasible solution x E N™ 9 to 
the generalized n-fold integer programming problem (2), or asserts that no feasible solution exists. 

Proof. Introduce 2n(r + s) auxiliary variables to the given generalized n-fold integer program, and 
denote by z the resulting vector of n(2(r + s) + q) variables. Consider the auxiliary integer program 
of finding a nonnegative integer vector z that minimizes the sum of the auxiliary variables subject to 
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the following system of equations, with I r and I s the r x r and s x s identity matrices: 
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This auxiliary program is in fact again a generalized n-fold integer program, with matrices A = 
{A, 0, 0, I r , —Ir) and B = (B, I s , —I S ,Q, 0). Since A and B are fixed, so are A and B. Due to the special 
structure of the auxiliary program, a feasible solution of this program can be written down easily in 
terms of b. Consequently, the auxiliary program can be solved by the algorithm underlying Lemma l5,H 
in time polynomial in n and the bit size of b. Since the auxiliary objective is bounded below by zero, 
the algorithm will output an optimal solution z. If the optimal objective value is (strictly) positive, 
then the original n-fold program (2) has no feasible solution, whereas if the optimal value is zero, then 
the restriction of z to the original variables is a feasible solution x of the original program (2). □ 

Combining the results of Lemmas 15 . 1 1 and 15 . 21 we obtain the main result of this article. 

Theorem 11.21 Fix any pair of integer matrices A, B of compatible sizes. Then there is a polynomial 
time algorithm that solves the generalized n-fold integer programming problem on any input n, b, c. 

Clearly, Theorem 11.11 is deduced from Theorem 11.21 in the special case B = I q . We emphasize again 
that, by solving the generalized n-fold integer programming problem, we mean in the complete sense 
that the algorithm concludes with precisely one of the following: it either asserts that there is no 
feasible solution, or asserts that the objective function is unbounded, or returns an optimal solution. 
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